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Abstract. We propose a method to calculate the large deviations of current 
fluctuations in a class of stochastic particle systems with history-dependent rates. 
Long-range temporal correlations are seen to alter the speed of the large deviation 
function in analogy with long-range spatial correlations in equilibrium systems. We 
give some illuminating examples and discuss the applicability of the Gallavotti-Cohen 
' fluctuation theorem. 
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1. Introduction 

Within the context of stochastic many-particle systems there has recently been 



> 

OO . considerable interest in the calculation of distributions of current fluctuations, see 



e.g., [Ij. Typically such distributions obey a large deviation principle with a rate function 
playing a role analogous to the entropy in equilibrium systems|||. Under rather general 
^ . conditions, the ratio of probabilities for "forward" and "backward" particle currents 
O ■ obeys a so-called "fluctuation theorem" [3l H] as reflected in a particular symmetry 

property of the large deviation function, see e.g., [5, 6J. 
^ . The majority of previous works on stochastic dynamics have been concerned 

with Markovian systems. However, the inherent memoryless assumption may be an 
inappropriate approximation for the modelling of many "real-life" processes where long- 
range temporal correlations are known to be important, see e.g., [3 [3 El |10] and 
references therein. On a coarse-grained scale, memory effects have been successfully 
treated using generalized Langevin or Fokker-Planck equations [HI [121 US]- At 
the microscopic level of modelling a well-established paradigm is the continuous- 
time random walk [14J; for some biological applications see [15]. The validity of 
fluctuation relations for non-Markovian systems has also been explored using both these 
approaches [IHl HH UHl [191 [20l [2l] . 

J See [2] for a general discussion of the large deviation approach to statistical mechanics. 
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An alternative strategy to introduce long-range memory into microscopic dynamics 
is to introduce an explicit history-dependence in the rates as is done, for example, in 
the "elephant" and "Alzheimer" walks [221 [231 El ES, [26l [27] or the negative mobility 
random walk of Cleuren and Van den Broeck [28]. Motivated by such models, in the 
present contribution we consider current large deviations in a class of stochastic processes 
where the rates at a given time depend on the past history of the current. For such 
systems we propose a "temporal additivity principle" as a method for calculation of rate 
functions. Our approach is in the spirit of the spatial additivity principle introduced 
by Bodineau and Derrida [29]; we demonstrate it on various random-walk models and 
discuss its wider applicability to many-particle systems. The examples considered allow 
us to illuminate some generic effects of the long-range memory (in particular, a modified 
"speed" in the large deviation principle) and test the validity of the fluctuation theorem. 

2. Stochastic framework 

Let us first consider a continuous-time Markov process in discrete state space. A 
particular realization of its history over the time interval [0, t] is given by {cr(r), < r < 
t}. We assume here time- independent dynamics which are specified by the transition 
rates w„>„; in other words, the probability for a transition from state a to state a' in 
the infinitesimal time interval [t, t + dt] is w^r^ dt. 

In the following we use script letters to denote functionals of the trajectory cr(r). 
In particular, we define a counter Qt which has initial condition Qo = and increases 
by an amount Q^'a each time the transition a ^ a' occurs. If the matrix B is real 
and antisymmetric we can say that it describes a real or abstract "current" through 
the system. For example, the time-integrated particle current from left to right, say, is 
given by adding 1 every time a particle hops to the right and subtracting 1 every time a 
particle hops to the left. The fluctuations and symmetry properties of general particle 
currents are central to our investigations. 

The integrated current Qt is time-extensive and it follows that Qt/t is a time- 
intensive functional. We denote a given realization of the latter's history by {g(r),0 < 
T < t} and use the symbol j for the terminal value, i.e., q{t) = j. Although Qt is 
discrete, Qt/t approaches a continuous random variable as t ^ oo and we assume it 
satisfies a large deviation principle with "rate function" I and "speed" t, i.e.. 



where the symbol ~ means logarithmic equality in the limit of large tl§[ Here the precise 
form of Iw depends on the particular process considered, i.e., on the set of rates Wa'a- As 
a concrete example the reader is invited to think of a single particle on a one-dimensional 
(ID) lattice which hops to the right with rate vr. The integrated particle current in time 
t is simply the number of jumps made by the particle and the time-averaged (intensive) 

§ The term "speed" is used in large deviation theory to denote the t-dependent coefficient in front of 
the rate function [301 12; it has nothing to do with the physical speed. 




(1) 
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current obeys a large-deviation principle with rate function Iv^U) = vr— j + j\n{j /vji) 
which is simply obtained from considering the asymptotic properties of the Poisson 
process. Large deviation functions have also been investigated for more complicated 
systems of many interacting particles such as the exclusion process [311 ES] and the zero- 
range process [331 EH EH]- The latter model also illustrates some interesting subtleties 
which may arise when the state space is unbounded. In particular, for ergodic systems 
with finite state space the rate function is independent of the initial state of the system 
(i.e., the initial particle configuration) but this may not be true for infinite state space 
[361 12] • We defer consideration of such issues to a later publication and restrict ourselves 
here to situations where there is no initial-configuration dependence. 

We now generalize the previous setup to consider a simple type of non-Markovian 
process where the rates w^'a depend explicitly on cr, a' and the value of Qt/t. This 
introduces a dependence on the complete history of the process although we note 
that, in the enlarged current-configuration state space, the process is Markovian. This 
class of systems includes analogues of the "elephant" random walk introduced as a toy 
non-Markovian model in [23] and further analysed in [2H [25l [27] . In order to avoid 
singularities which arise at r = we assume that our observations start at time to 
where ^ to ^ ^- Physically, non-zero to allows for initial "transient" behaviour with 
different transition rates; this is analogous to different probabilities at the first timestep 
in the original discrete-time elephant [23]. 

Systems of the type defined above are expected to show long-range memory effects 
which threaten the simple form of the current large deviation principle ([T]). In the next 
section we propose a general principle to obtain the asymptotic distribution of current 
fluctuations in such models. 

3. Temporal additivity principle 

Here we outline the steps leading to a "temporal additivity principle" (JHl) noting that 
many elements of the argument are analogous to those given for spatial additivity in [29]. 
First we divide the time interval [to,t] into N sub-intervals of size At and write 
= ^0 + nAr with tjy = t. We use the notation p{o'n,qn,tn) for the probability that 
the system is found in the state (o"„,g„) at time t and p{qn+i,o'n+i,tn+i\(ln,<^n,tn) for 
the two-point conditional probability. Since the system is Markovian in the joint state- 
current space, we have the Chapman-Kolmogorov equation 

p{qN,<yN,t\qo,ao,to) 

= X] p{qN,crN,t\qN-i,aN-i,tN-i) ■ ■ ■piq2,o-2,t2\qi,ai,ti)p{qi,ai,ti\qo,ao,to) (2) 

qi,...,qN-l 

Now if At ^ 0, then p(g„+i, o"„+i, t„_|_i|g„, cr^, t„) can be assumed independent of (T„, at 
least for an ergodic system with finite state space. In this case, summing over the a^'s 
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m ([2j) gives 

PiQN,t\qo,to) = piqN,t\qN-i,tN-i) ■ ■ ■piq2,t2\qi,ti)p{qi,ti\qo,to){3) 

giv,qjv~i 

This shows that, when considering long time shces, the dynamics in the g-space 
is Markovian, although we emphasize that the underlying dynamics of the system's 
configurations (i.e., the dynamics in cr-space) is non-Markovian. 

Next we take t and large, whilst preserving their ratio, so that t ^ At 
meaning that g(r) is almost constant during each time slice (adiabatic or quasistatic 
approximation). The observed current averaged over the time interval (tn,tn+i] is given 
by 

(n) qn+ltn+1 q-ntn / j\ 

IaI = (4) 

and thus, using the large deviation principle of ([T]), we have 

t„) ^ A„e-^"^»(«")(''A-') (5) 

where An is a g-independent constant. Here the subscript on the Markovian rate function 
/ emphasizes that it depends on the value of g„ via the dependence on the (assumed) 
constant rates w„i„{q). Substituting ([5]) in ([3]) yields 

p{qN,t\qo,to) ^ A ^ e"^"=o' ^^■^»(^")(^Ar). (6) 

At this point, we pass to the continuum limit by taking t, Ar oo with Ar/t — > 0, 
in which case oo. In this limit g„ becomes a continuous path, so that g„, q{T) and 
q^^l —>■ qij) + Tq'ij). Then the sum in ([6]) becomes a path integral over the trajectories 
g(r) and (using jo and j for the fixed boundary values) we have 

p(j,t|jo,to) ~ f^^~' p[g]e-ii;^-(^)(^+-''')'^^ (7) 
>^<?(*o)=io 

In the t ^ oo limit, we expect this path integral to be dominated by the path in g-space 
for which the exponent in the integral is least negative, and so we apply a "saddle-point 
approximation" to arrive at our central result for the asymptotic distribution of Qt/t: 



PToh{Qt/t = j) ~ exp 



min / J^(g)(g + rg') dr 
Jto 



(8) 



The integral above has to be minimized over all trajectories g(r) with g(to) = Jo and 
q(t) = j. Note that for notational brevity we have suppressed the dependence on go, to 
on the left-hand side of this equation in anticipation that the initial condition will not 
play an important role. Finally, to make the dependence on t more explicit, we can 
re-write the result of (IHl) as 

Prob(Q<A=j)~e-*"^(^), (9) 

where a is some positive constant and 

1 /■* 

E{j) = hm niin — / I^^q){q + rq) dr. (10) 

t^oo q{T) t" y^jj 
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If this function exists and is not everywhere zero, then we have that Qt/t satisfies a large 
deviation principle with speed and rate function E{j). For Markovian processes, the 
exponent a is usually equal to 1 [Ml E]- However, we shall see in the next section that 
the g-dependence of the rates in our setup can give rise to a non-standard speed with 



4. Random-walk examples 

As a simple pedagogical model, we first consider a "uni-directional random walk" on a 
ID lattice. Here g(r) denotes the velocity trajectory (number of jumps divided by time) 
of a single particle which hops at time r from site i to site i + 1 with rate VR{q). In this 
case, since the associated Markovian process is Poissonian, we have 

Iv^i,){q + rq')=Vn{q)-{q + Tq') + {q + Tq')\n f^^^T^^ for g > 0(11) 



and minimizing the integral in ([8]) leads to the Euler-Lagrange equation for the minimum 
path 

dvR dvn/dq 2rg' r^g" 

— q = 0. (12) 

dq Vr q + rq' q + rq' 

To explore scenarios where the rate for the particle to move is directly proportional 
to the average velocity up to that instant, we set f/j(g) = aq. In this case ( IT2|) is a linear 
differential equation which has general solution 

q(r) = CiT-^ + C2t''-\ (13) 

The boundary conditions g(to) = Jo and q{t) = j fix the constants as 

^ +a j-a ' ^ JQ, +a ' ^ ' 

and, integrating over this path, it is straightforward but tedious to show that the 
asymptotic behaviour for large t is 

■ f\ , 1 f J^n^^^" for a < 1 

mm / I^,a\{q + Tq')<\T I , , , , (15) 
^ir)Jt, \ {a - l)joto\nt fora>l. ^ ' 

Physically, we note that at a = 1 there is a crossover between an "escape" regime and a 
"localized" regime. For a > 1 the mean velocity of the particle grows indefinitely with 
time, there is no stationary state and no large-deviation principle. On the other hand, 
for a < 1 the system approaches a state with zero velocity and we have 

PToh{Qt/t = j) ~ e-*'""^*S, for j > 0. (16) 

i.e., a large deviation principle with speed and rate function jt^. In fact, this is an 
exponential distribution for Qt/t so one straightforwardly finds the asymptotic moments 

mt/t] - Var[Q,/t] ~ -^1^. (17) 
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From the latter equation one trivially sees that VarfQ^] ~ (t/^o)^" and hence that there 
is a transition between "sub diffusive" and "super diffusive" behaviour at a = 1/2. This 
is related to a similar transition found in the elephant random walk of Schiitz and 
Trimper ^3\, a connection to which we shall later return. 

Next we turn to the more interesting case of a bi-directional random walk, again 
on a ID lattice. For full generality, we now count separately the total number of jumps 
to the right, Q+j, and the total number of jumps to the left, The net integrated 

current is given by Qt = Q+t — Q-t and we choose rates which can depend on the 
present values of both Q+t/t and Q-t/t, i.e., at a given point in the trajectory the rates 
are generically VR{q+, g_) and VL^q^, g_) for jumps to the right and left respectively. In 
an obvious generalization of the previous treatment we then have 

Prob(Qi/t = j) ~ exp I min / vr - (g+ + rg^) + {q+ + rg^) In ( '^^ '^^^ ] 

[q+{T),q-{r) [ \ Vr J 

+VL - {q- + rq'_) + (g_ + Tq'_) In (^^^^^^ drj . (18) 

where the integral is to be minimized over all q+{T), ^-(t) obeying the boundary 
condition q_{to) = j_o, g+(to) = j+o, q-{t) = j_, g+(t) = j+ = j + j- Here one 
has to solve two coupled Euler-Lagrange equations 

dvR _ ^ dvR/dq+ I / dvn/dq- , dvL _ ( r, J- ^r,' \^^^±!^3± _ ^^9+ _ ^^9+ 



(19) 



dq+ VB^ VR dq+ vl q++Tq_^^ q++Tq_^_ 

_ djnjdq^ , c2^njl^ =0. 

dq- ^ Vl ^+ Di, oq- ^ + ' Vr q-+Tq_ q-+Tq_ 

These equations are exactly solvable for various choices of memory dependence including 
the interesting case of "activity" -dependent rates with a constant bias which we explore 
in the next paragraph. 

A measure of the total activity of the system is given by the symmetric sum of left 
and right currents; for our second concrete example we consider rates proportional to 
the time average of this quantity, viz. f_R(g+, g_) = a(g+ -|- g_), v^iq+y q-) = c{q+ + g_). 
Without loss of generality, we take a > c, i.e., a drive to the right. For the case 
a + c < 1, after solving the Euler-Lagrange equations with the required boundary 
conditions, carrying out the integration and minimizing with respect to j_ one obtains 
the leading terms in the exponent of the asymptotic distribution 

ProbfO /t - 71 ~ ^ ^M-jC' m t'—^] for J > 

Prob(Q,/t-j)~<! ,,p[^.(i,.), + ^,..c(^),,._] (20) 



Note that for c = this reduces to (1161) as it should. The form of this distribution is 
in good agreement with the output of numerical simulation as shown in figure [H In 
particular, we observe that the dominant term in the exponent is different for positive 
currents than for negative currents — being proportional to respectively t^^"^^ and t. 
In a strict mathematical sense this means that Qt/t obeys a large deviation principle 
with speed t and rate function which is only non-zero for j < 0. Physically, it implies 
different scaling for fluctuations in the forward and backward directions. 
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Figure 1. Simulation results for distribution of currents in activity-dependent random 
walk with a — 0.4, c = 0.2, Iq = 10, j+o = 0.1, j_o = 0. Main plot shows 
— ln[Prob(Qt/f — j)]/t versus j: points are simulation data for t — 110, 410, 1610, 6410 
(top to bottom); dotted line is prediction of ([20| for t — 6410 and solid line the infinite 
time limit. Inset shows — ln[Prob(Q(/i = for positive j (same parameters). 



Even for single-particle random walks there are relatively few choices for the 
rate-dependence which lead to Euler-Lagrange equations susceptible to exact solution. 
However, in many other cases one can make progress via a Gaussian approximation 
analogous to that applied for the spatial additivity principle [21] • For instance, for the bi- 
directional random walk one makes an expansion about the mean steady-state currents 
g+(r) and ^-(t) which obey g+ = fij(g+,g_) and g_ = VL{q+,q-)- Such an approach 
allows us to treat, for example, the case VR{q+,q_) = aq+ + b,VL{q+,q-) = cq+ + d 
and obtain results which are essentially just asymmetric generalizations of the original 
discrete-time elephant in [23]. For example, for 0<a, c<l/2 one finds 

d n2 - 



t 



Prob(Q(/t = j) ~ exp 

' (l-a)(l-2a) ' (l-c)(l-2c) , 

For 1/2 < a, c < 1 one again has "superdiffusive" behaviour, e.g., for a 



— + 

l-a ' 1- 



;)• 



Prob(Qf/t = j) ~ exp 



1(1 
2 



l-g ^ 1-aJ 
b+d 
(l-a)(2a-l) 



2a- 



2a 



(21) 



(22) 
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5. Fluctuation symmetries 

Here we use the bi-directional examples of the previous section to illustrate the validity 
of fluctuation symmetries for memory- dependent systems. First, we note that for the 
random walk with activity-dependent rates ( !20l) imposes 



Prob(Qf/t = -j) 
Prob(Qt/t=+j) ^''''P 



-j(ln-)tl (23) 
c J 

which is just the usual Gallavotti-Cohen fluctuation relation [31 HI [5]. Indeed this is 
to be expected since, for this particular model, the relative bias felt by the particle is 
constant, vr/vl = a/cjjj] In a sense, this example is thus rather trivial but it is already 
an illuminating reminder that the validity of the fluctuation theorem is not restricted 
to the usual Markovian cases where one has Prob(Q(/t = j) ~ Q-^^^i) for both positive 
and negative currents. 

Now we turn to consider a biased elephant walker with t>R(g+,g_) = ag+ + 6, 
VL{q+,q-) = aq+ + d. Within the Gaussian approximation given by (pTj) and fl22|) . we 
have 



Prob(Qf/t = -]) 
Prob(Qt/t= +j) 




■ 2(b-d){l-2a) ^ 

_ ■ 2(b-d){l-2a) ^2a-1^2-2a 
J 1— a 



for < a < 1/2 

(24) 

for 1/2 < a < 1. 



We remark that in both cases there is a well-defined mean current given by g = 
{b — d)/{l — a) but only for < a < 1/2 is a fluctuation relation of the usual form 
recovered. For 1/2 < a < 1 the symmetry is apparently modified by the "super diffusive" 
spreading about the mean. In this case, the logarithm of the ratio of probabilities for 
currents —j and +j is still asymptotically proportional to j but is sublinear in t. This 
scenario should merit closer investigation in other models. 



6. Discussion and further applications 

In principle, the temporal additivity principle presented above can be applied to any 
stochastic system where the corresponding (Markovian) large deviation function I^ij) 
is known. In practice, the resulting Euler-Lagrange equation may not be analytically 
tractable. However, we suggest that the approach still has considerable numerical utility 
since the integral in ([8]) should be amenable to minimization by standard algorithms. 
In particular, it would be interesting to investigate the applicability of the method to 
systems with dynamical phase transitions. One such model is the zero-range process 
with open boundaries in which exact expressions for the Markovian large deviation 
functions are known and can be related to those of random walks with certain effective 
rates [37]. This suggests that some of the memory-induced effects observed in the 

II In fact, it seems that the system also shows the symmetry for the case a + c > 1 when there is 
obviously no stationary state in the usual sense. This is a simple counterexample to the suggestion 
in 1 17] that the existence of a stationary state is necessary for fluctuation relations in non-Markovian 
processes. 
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simple examples of section H] may also be observed in more complicated many-particle 
systems. In particular, we conjecture that long-range temporal correlations in non- 
equilibrium systems may alter the speed of the current large deviation function in an 
analogous way to long-range spatial correlations modify the speed of equilibrium large 
deviations [381130]. Further work in this area is needed to establish the exact link between 
the speed of a large deviation principle and the "long-rangedness" of correlations. 

Finally, we remark that the additivity formalism could also be applied to 
intrinsically non-Markovian systems where the rates at time r depend, e.g., on Qt'/t' 
where r' = xt and x is a positive constant less than unity (cf. the "Alzheimer" random 
walk l26l l27j). However, in that case, the integrand in ([8]) becomes non-local 
and minimization correspondingly difficult. There is clearly much scope for future 
analytical work on current fluctuations in non-Markovian systems as well as for the 
development of efficient simulation algorithms for measuring the corresponding large 
deviation functions. 

Note added: After submission of this work there appeared an interesting 
preprint [39] discussing similar issues for a different class of non-Markovian systems, 
namely semi-Markov processes. 
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